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Indispensable Resources for Institutional Researchers: 
An Analysis of AIR Publications Topics Since 1974 



This paper identifies and classifies the AIR publication topics and authors in order to 
provide a valuable reference resource for institutional researchers. Beginning with the first 
volumes of Research in Higher Education (RIHE) in 1973 and New Directions for Institutional 
Research (NDIR) in 1974, the Association for Institutional Research (AIR) has supported a 
growing array of publications that strengthen the professional development of its members and 
other higher education professionals. There are now five AIR-affiliated publications that 
publish, review, or commission scholarship that is aimed directly at the diverse audiences 
represented by the members of the AIR. 

In addition to the six volumes each year of RIHE, there are now four volumes each year of 
NDIR. the AIR Professional File (PFile) which is about to publish the 65th of its topic-focused 
papers, the monograph series Resources in Institutional Research (RIR) with its 1 1th volume in 
press, and the annual Higher Education Handbook of Theory and Research (HEH) which has 
published 12 volumes of commisioned scholarly analyses. NDIR is published by Jossey-Bass in 
San Francisco, the HEH is published by Agathon Press in New York, RIHE is published by 
Human Sciences Press in New York, and the PFile and RIR series are published by the AIR in 
Tallahassee. Appendix A contains more information about each of these five publications. 



METHOD 



The objects of this analysis are 100 volumes of NDIR (92 circulated and 8 in preparation), 
over 40 chapters in the twelve volumes of RIR (10 volumes produced and 2 in preparation), 65 
issues of the PFile (63 out and 2 in press), and the 124 chapters in 12 volumes of HEH. The 
almost 1,000 articles contained in RIHE since 1973 proved to voluminous to be included here 
and will receive separate analysis. The classification of publications and topics presented here is 
based on the shared judgements of an institutional researcher, faculty member, and two graduate 
students. 

We developed a matrix of topics and publications by relying upon the seven AIR Forum 
Tracks as the most convenient and widely recognized schemata for classification. Each AIR 
Forum is organized into seven tracks that focus on the major functions of institutions (teaching 
and learning by faculty and students), the management and support of these functions 
(administrative services, policy analysis, planning, resource allocation, and governance), and 
the role of institutional research (theory, practice, technology, tools). The seven tracks are 
described in various AIR materials as follows: 
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Track 1 -- Enrollment Management and Student Affairs 

This track focuses on undergraduate and graduate participants in postsecondary education. Topics 
include enrollment planning and projections, recruitment and retention, student needs assessments, 
student profiles, and student financial aid. 

Track 2 -- Institutional Effectiveness, Student Learning, and Outcomes Assessment 
This track concerns the assessment of institutional effectiveness and student outcomes. Related topics 
include the assessment of general education, the academic major, affective student learning, retention, 
and other aspects of student life related to teaching and learning. Measurement issues and effective 
data collection techniques related to these topics are especially relevant. 

Track 3 -- Academic Program and Faculty Issues 

This track addresses issues related to curriculum; research and scholarly productivity; public service; 
tenure policies; program review; faculty recruitment, development, and retention; faculty flow models; 
collective bargaining; salary models; faculty evaluation; and decision making regarding faculty and 
academic programs. 

Track 4 — Resource Management and Quality Improvement 

This track involves resource allocation, budget and finance issues, quality improvement and cost 
containment initiatives, human resources/personnel issues, allocation and expansion of capital facilities 
and equipment, and institutional advancement. 

Track 5 — Policy Analysis, Planning, and Governance 

This track emphasizes the major governance and executive functions of an institution. Issues include 
policy and management analyses, strategic and tactical planning processes, institutional mission 
development, operations research, and decision support. 

Track 6 - Theory, Practice, and Ethics of Institutional Research 

This track describes the role, scope, and evolution of institutional research within and across 
institutions. It includes surveys of institutional research practice, evaluation models for assessing the 
research function, techniques for managing the institutional research office, and the ethical and political 
dimensions of practicing institutional research. Theoretical discussions of research design and 
statistical applications - but not computer demonstrations, which are part of Track 7 - are also 
appropriate. 

Track 7 -- Technology and Tools for Institutional Research 

This track highlights the development and usage of technologies and tools in computer applications, 
information processing and reporting, and telecommunications which can influence institutional 
research demonstrations and presentations of database design and management electronic 
communications, and information analysis and reporting that affect the efficiency and effectiveness of 
institutional research are especially sought for this track. 



In conducting this study, we had to overcome two obstacles. First, these seven categories 
are not neatly separable and many overlap. Studies of retention are listed in the descriptions both 
for Track 1 {enrollment management & student affairs) and for Track 2 {effectiveness & 
outcomes assessment). Many topics lodged elsewhere (such as TOM) could properly be 



described as falling within Track 2 and its emphasis on institutional effectiveness. Nevertheless, 
we compartmentalized the topics within each track as best we could and stuck to consistent 
judgements about each publication. For example, all attrition/retention studies are grouped with 
student tracking and appear under enrollment management. 

A second problem is that many studies contain portions that fall into more than one topic 
(e.g., a policy analysis of student financial aid and loan default, or a study of diversity and gender 
issues that impact faculty turnover or student satisfaction). This is particularly true in the RIR 
and NDIR volumes where a single topic is examined from multiple perspectives. We resolve 
these problems by listing such publications under multiple topics. 

In reviewing approximately 350 publications, chapters, and articles for this exercise, we 
aggregated them into almost five-dozen sub-topics which account for nearly all the diversity of 
coverage and seem to have face validity from the shared judgements of the institutional 
researcher and graduate students involved in the process. 



RESULTS 



The results of our analysis are shown in Table 1 . The five dozen AIR Tracks and sub- 
topics are listed in the first column of the table. The second column displays how we classify the 
100 volumes of New Directions for Institutional Research (NDIR) that are published and 
planned. The middle column shows our analysis of the 65 Professional Files. The Resources in 
Institutional Research (RIR) column indicates where we slotted its various volumes and 
chapters. In the final column, we display the relevant chapters from the Higher Education 
Handbook of Theory and Research (HEH) by topic area. The cells within the columns for NDIR, 
PFile. RIR. and HEH contain the volume numbers and authors for each publication related to that 
topic. In Italics are the manuscripts under development. 

For Track 1. we see 35 publications related to enrollment management and student affairs 
topics. Not surpringly, the most attention is given to analyses of student retention and 
persistence, with three NDIR volumes, six Pfiles, two RIR chapters, and two HEH chapters. 
While student affairs issues per se have not received a great deal of attention in AIR 
publications, NDIR and HEH are providing good coverage to financial aid issues. 

Track 2, on institutional effectiveness and outcomes, constitutes perhaps the most diverse 
and prolific publications area for these AIR works. We found over 55 publications that address 
important topics within the dozen sub-areas in this track. NDIR in particular is giving solid 
coverage to topics dealing with accountability, program review, alumni studies, and graduate 
education. Receiving the greatest publications attention is outcomes assessment, with 14 
publications across all four sources. 



About 30 of these publications are aimed at the faculty and academic issues represented in 
Track 3. HEH gives this area solid coverage (15 chapters), followed by NDIR with seven 
volumes. RIR devotion to these topics is limited to one chapter each in the Primer and the 
Bibliography. 

The resource management and quality improvement areas of Track 4 are addressed by 
over 50 AIR publications, spread rather evenly across all four sources and nine sub-topics. The 
most thorough coverage is offered by NDIR’s 22 volumes. 

Track 5 is the most diverse aggregation of subjects, and we divided it into 12 sub-areas. 

32 HEH chapters and 22 NDIR volumes account for most of the 64 publications directed at these 
various administrative issues related to policy, planning, and governance. Planning and strategic 
planning have received the most attention from NDIR, while HEH has given most of its attention 
to leadership, campus/govemment relations, and campus issues related to 
culture/climate/diversity /gender. RIR and PFile contributions to Track 5 topics are relatively 
light. 

Institutional Research studies itself in Track 6, and the 16 or so publications here are 
limited to NDIR. PFile, and RIR. HEH is more oriented toward higher education in general and 
less to I R in particular. 

Track 7 covers research methods, tools, and technology. This is an important skills area 
for researchers, and we divided it into ten sub-topics that have received reasonably even coverage 
by these four publication sources. NDIR has aimed 23 volumes at Track 7 topics, and 17 of them 
examine one aspect or another of informations systems and data management. There are 
seventeen PFile issues in Track 7, and a growing collection of RIR volumes. The majority of 
HEH chapters focus upon statistics and research methods. 

Looking holistically at the results, we conclude that the profession has made progress 
toward developing a growing array of publications resources to support research practitioners. 
While complete and current coverage will be a continuing challenge, these AIR-affiliated 
publications are collectively supplying important coverage that appears to be growing at a 
healthy rate. We need to bring analyses such as this to the attention of our colleagues in the field 
in order to increase their awareness and professional development. 



AIR Publications Addressing Critical Topics in Institutional Research 
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APPENDIX A 

Descriptions of AIR Publications 



1 . Research in Higher Education (RIHE). 1973 



Editors 

Charles F. Elton, 1973-1990 
John C. Smart, 1990 + 



Associate and Assistant Editors 
Cameron Fincher 
James C. Hearn 
Jean J. Endo 



R1HE is the official journal of the AIR and is published six times a year by Human Sciences 
Press, Inc., a subsidiary of Plenum Publishing Corporation. Founded in 1973, RIHE contains research 
papers that generally, but not exclusively, stress empirical studies of colleges and universities. The 
journal describes its purpose as publishing scholarly works that contribute to our collective 
understanding of one or more institutions of higher education in order to aid faculty and administrators 
make informed decisions, and to improve efficiency or effectiveness. RIHE has established itself as 
higher education’s most selective journal with a manuscript acceptance rate ranging between 10% and 
15%. John Smart works with 30 consulting editors. 

The February issue each year contains the outstanding papers from the previous AIR Forum; 
and the final issue in each volume contains an index by author and subject. The six volumes of RIHE 
in 1996 average 126 pages and contain 31 articles and one “AIR Between Forums.” Almost 1000 
studies have been published in RIHE since 1973. This number is too large to have included them in the 
topic matrix contained in this paper, but they deserve separate analysis. A study of the first 15 years of 
RIHE scholarship concluded that the top five topics covered in RIHE were faculty issues, 
administration/management/governance, research issues/methods, student issues/services, and 
curriculum/instruction. (Volkwein, Carbone, and Volkwein, RIHE, 1988) 



2. New Directions for Institutional Research (NDIR). 1974 



Editors-in Chief 

Sidney Suslow and Paul Jedamus, 1973-77 
Paul Jedamus, 1977-78 
Marvin W. Peterson, 1978-84 
Patrick T. Terenzini, 1985-95 



Associate Editors 



Patrick T. Terenzini, 1983-84 
Marvin W. Peterson, 1985-89 
Ellen E. Chaffee, 1990-93 
J. Fredericks Volkwein, 1994-95 
Larry L. Litten, 1996 + 



J. Fredericks Volkwein, 1995 + 



2. NDIR (cont’d) 

New Directions for Institutional Research is a quarterly sourcebook published by Jossey-Bass 
under the sponsorship and policies of the Association for Institutional Research. Each NDIR issue 
focuses in detail on a specific topic relating to institutional research, planning, or higher education 
management in general. The Editor-in-Chief and Associate Editor select the topics and issue editors in 
consultation with the Publications Board of the AIR. The issue editors are recognized authorities who 
assume responsibility for developing the volume and selecting appropriate individuals to write each 
chapter. The Editor-in-Chief is responsible for planning, coordination and quality control, and with the 
Associate Editor, exercises this responsibility by assisting each issue editor plan the volume, select 
appropriate chapter authors, and then review their work to ensure that they meet publication standards. 
Manuscripts from each author must survive a two-level review (volume editor and NDIR editor) and 
meet standards for both content and style before they are published. 

NDIR volumes normally contain five to ten chapters that examine the various dimensions of each 
topic, summarize the latest information, and point to future directions. Volumes run 95 to 120 pages in 
length and have an annotated table of contents, explanatory headnotes, an index, and a list of sources 
for additional information. NDIR has been one of the most successful in the Jossey-Bass series, and 
1998 marks its Silver Anniversary with the production of Volumes 97-100. 



3. The AIR Professional File (PFile). 1978. 

Editors 

Richard R Perry, 1978-83 

John A. Lucas, 1984-96 

Mardy T. Eimers, 1996 + 

The Professional File began in 1978 as a commissioned publication of the Association for 
Institutional Research. Averaging three per year, each issue contains a single article of 10 to 16 pages 
and is distributed to that year’s AIR members as a benefit of membership. The PFile’s purpose is to 
enhance the practice of institutional research by providing a continuing collection of selected writings 
which examine institutional research operations and exemplary practice, and which synthesize and 
interprete relevant issues and research. In the early years, there was no advisory committee to work 
with the Editor, but the publication decisions now are increasingly carried out through The PFile’s 
Advisory Committee which has recently grown from ten to fourteen institutional researchers. They 
review submitted manuscripts and make recommendations for publication to the Editor. Approximately 
one out of three manuscripts are selected for Publication. 



4. Resources in Institutional Research (RIR) 

The RIR Series was created in 1992 as a product of strategic discussions between the AIR 
Executive Director and the Publications Committee. The purpose of this series is to produce for the 
membership and give greater visibility to the growing number of important AIR monographs. Starting 
with the now classic Functions of Institutional Research by Joe L. Saupe (first published in 1981), the 
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series includes the Primer for Institutional Research (now in its second edition by.Whiteley, Porter, and 
Fenske), the Bibliography of Reference Sources (edited by Fendley & Seeloff), the best-selling 
Questionnaire Survey Research (now in its second edition by Suskie), Strategies for the Practice of 
Institutional Research (by Middaugh, Trusheim & Bauer), and Statistical Applications in IR (by 
Coughlin & Pagano). These last three are publications based upon AIR Institute Workshops, and at 
least two others are expected from the Institute series. 



5. The Higher Education Handbook of Theo ry and Res earch (HER), 1985 -* 

Editor: John C. Smart, 1985 + 

Associate Editors (topic areas) 

Philip G. Altbach (comparative higher education) 

Alan E. Bayer (faculty) 

Clifton F. Conrad (graduate and professional education) 

David D. Dill, Kenneth P. Mortimer (governance and planning) 

Corinna A. Ethington, Ernest T. Pascarella (research methodology) 

James C. Hearn (government and higher education) 

Barbara A. Lee (legal issues) 

David W. Leslie (institutional policy issues) 

Larry L. Leslie (finance and resource allocations) 

Raymond P. Perry, Cameron Fincher (curriculum and instruction) 

Marvin W. Peterson, Kim S. Cameron (organizational theory and behavior) 

Patrick T. Terenzini (students) 

John R. Thelin, Lester F. Goodchild (history and philosophy) 

William Toombs (continuing education for the professions) 

Richard A. Voorhees (community colleges) 

Started in 1985, the Higher Education Handbook publishes one annual volume (Agathon Press) 
and is jointly sponsored by AIR and the Association for the Study of Higher Education (ASHE). The 
Handbook is organized around twelve higher education topic areas, each with its own Associate Editor. 
These twelve areas reflect the richness and diversity of the field in terms of subject matter interests and 
methodological perspectives. The Associate Editors provide general leadership and direction for each 
topic area and they work with the contributing author(s) for each chapter. While the typical pattern is 
to have one chapter per research area in each volume, there are volumes in which an area is not 
represented, or is represented by more than one chapter. With some of the annual volumes running to 
500 pages, each chapter is a major work. 

As described in the first edition, the Handbook was established on the belief that the further 
maturation of higher education as an area of scholarly inquiry is contingent upon our ability to bring 
order and understanding to our increasingly rich, diverse, and fragmented research findings. The HEH 
thus provides an annual compendium of exhaustive and integrative literature reviews on a diverse array 
of topics. Each annual volume seeks to strike a balance between comprehensiveness and depth of 
coverage. Contributing authors are selected for their recognized expertise in the specific specialty 
areas. The charge to each author is threefold: to provide an integrative review of extant research on 
the selected topic, to critique that research in terms of its conceptual and methodological rigor, and to 
set forth an agenda for future research. 
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